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Abstract 

‘6 
In order to understand the factors contributing to an identified early 
attrition rate for families referred to a child nieiakoe clinic, a 
procedure was developed for assessino clicnts' eathepaction with 
clinic services. Three brief Client Satisfaction Nuestionnaires were 
developed to assess clients’ attitudes and reactions to an injtial 
screening and diagnostic appraisal sequence of fntarviens wherein the 
areatist attrition was identified. Muestionnaires were roe to a 
sample of 238 families during a nine month period and return rates of 30% 
were achieved. Three classes of variables were examined for possible ; 
association with premature fernieatan Fin services: (a) client 
satisfaction was measured by questionnaire responses, (b) demoaraphic 


client characteristics, and (c) clinician characteristics. Premature 


terminators and clients who followed throuch with clinic services were 


indistinguishable on the basis of client satisfaction and demographic 
varijables. Contrary to expectations, clients who terminated prematurely 
did not have greater levels of dissatisfaction with clinic services and 


procedures. 
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Increasing emphasis on accountability in recent vears has necessitated 
evaluation of the usefulness and effectiveness of community mental health 
programs. A straightforward approach to such evaluation has been to 
survey consumers as to their perceptions of mental health services received. 
McPhee, Zusman and Joss (1975) have reported that the direct assessment of ) “ 
clients' satisfaction with Services has been a widely used evaluation 
approach in mental health.. Surveys of clients' perceptions of services 

and satisfaction levels have been conducted in a vartety of settinas, 
including; inpatient (Eder & Kukulski, 1975; Quilitch, 1978), outpatient 
{Oenner & Halprin, 1974; Hammer & Landsberq,1975; Hart & Bassett, 1975; 
Heinemann & Yudin, 1974; Littlepage, Kos loski, Schnelle, McNees & Gendrich, 
1976), and telephone crisis { ceevouneian aRtdiais (Preston, Schoenfeld & 


Adam¥, 1975). 


Previous studies have util deed a number,of methods to assess client 
satisfaction, such as; telephone interviews (Denner & Halprin, 1974; Hammer & 
Landsberg, 1975; Hart & Bassett, 1975; Heinemann & Yudin, 1974; Littlepaae 
et al., 1976; Preston et al., 1975), in-person interviews (Hart & Bassett, 


1975), mailed questionnaires (Denner & Halprin, 1974: Hammer & Landsberg, 
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1975; Heinemann & Yudin, 1974), and questionnaires completed in-person by * 


program participants (Eder & Kukulski, 1975; Quilitch, 1978). However, 
al t< " 
methodological problems , includine a lack of standardized measures and 
§ 
procedures for assessing satisfaction, have been pointed out (Albers, 1977). 


The majority of studies have surveyed post-tredtment client satisfaction 


" 
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and neglected systematic assessment of clients’ perceptions of services 
throughout their contacts with a qiven agency (e.q., Denner & Halprin, 1974; 
Hammer & Landsberg, 1975; Heinemann & Yudin, 1974; Littlepaae et al., 1976). 
Consistently "high" satisfaction rates reported in the literature (65% to 
85%) have also raised question concernina the influences of sampling 
problems, uncontrolled response ies and reluctance of clients to 
critically rate services provided (Albers, 1977; Preston et al., 1975). 

A pervasive problem identified in menta| health programs has Baan the 
premature termination or "dropout" of clients receiving outpatient 
treatment (Albers, 1975; Baekeland & Lundwall, 1975; Brandt, 1965: } 
Littlepage et al., 1976; Scrivner, 1975). Typically defined as termina- 
tion without the mutual agreement of the therapist, previous reports 
suggest that dropout rates of 50% or greater by the third appointment with 
an agency are not atypical (Baekeland & Lundwall, 1975; Banat 1965; 
Littlepage ct al., 1976). Extensive literature has been devoted to the 
identification of factors related to premature termination from treatment 


y 


(see Baekeland & Lundwall, 1975; Brandt, 19659%. However, inconsistent 
| A 
findings regarding variables associated with dropout has led ‘some 


¥ é 
investigators to conclude that characteristics are not identifiable that 


distinguish premature terminators from those clients who continue in 
treatment ( Brandt, 1965; Morrow, Del Gaudio & Carpenter, 1977: Stern, e 
Moore & Gross, 1975). Socioeconomic status has been the sole.client 
characteristic that has been consistently correlated with termination 


from treatment, wherein premature terminatorg are predominated by lower 


socioeconomic classes (Stern et al., 1975, 977). 


Z 
The survey of client satisfaction has been a little used approach to 


the study of factors related to premature termination. The assumption that 
_ premature terminators tend to be dissatisfied with services and failures in 
treatment has been frequently advanced (Littlepage et al., 1976). However, 
previous studies suggest a lack of consistent relationships between 
client satisfaction “f dropout. Kline, Adrian and Spevak (1974) found 
clients that terminated prematurely from rrontione: 1 be the least 
satisrien with services. In contrast, Littlepage et al. (1976) reported 
that clients who dropped out of therapy rated services as highly as 
those clients that followed through with treatment. A lack of positive 
correlations between the number of clinic visits kept by clients and 
satisfaction has also been pointed out (Hart & Bassett, 1975). These 
inconsistent findings have led Albers (1975) to conclude that no clear 
relationship between satisfaction levels and outcome in, treatment has been 
identified with present methodologies. | 

While the majority of studies on premature termination have examined 
dropouts following the start of formal treatment, a limited number of 
investigators have reported data on pretherapy or intake dropout. Few 
consistent differences have been found between clients that drop out prior 
to the start of therapy and those who drop out later. There is some 


suggestion that dropouts during the, intake process tend to be of lower 


socioeconomic status (Brandt, 1965), to give more excuses when schedul Yaa 
appointments (Bernal & Kreutzer, 1976), and to be more reluctant to accept 
‘responsibility for their problems (Brandt, 1965). 

Although the premature termination of adult clients has received the 


greatest attention, studies of dropouts from family and child mental 


5 
health programs have also been reported. Significant differences between 
dropouts and those who continue in child-related treatment hae not 
consistently been found. However, the primary influence of the parent in 
determining continuation in treatment has been emphasized,” Correlations 
have been found between dropout and the parent's socioeconomic status, 
awareness of the child's problems,-as well as acceptance and expectations 
of mental health services. (Baekeland & Lundwall, 1975: Brandt, 1965; 
Garcea & Irwin, 1962). 

The Battle Creck Child Guidance and Adult Clinic (BCCGAC). provides 
traditional outpatient guidance services’ to children/youth, parents and 
families. In keeping with the traditional child guidance model , a relative- 
ly routine screening aiid diagnostic assessment is made of families 
immedi ately following referral. A savant typically makes a referral of a 
child to the BCCGAC by telephoning the clinie and providing snecific 
referral information. Once the referral is made awcreening and diaqnostic 
study is begun with the parent(s) seen first for a screening interview by «+ 
a staff member. Subsequently, the child is seen for ao individual clinical, 
psychological and/or psychiatric evaluation interview as needed. The | 
final "interpretive" interview involves the presentation of a diagnostic 
formulation and treatment recommendation to the parent(s). While there 
are variations in the numbers and types of interviews conducted in the 
screening and diagnostic sequence, three to four interviews are typically 
hejd with a family. 


\ / 


An examination of the pattern of dropouts for families referred to 
the BCCGAC found Fak: Sanivdint nately 33% of all clients were seen for three 


or. fewer clinic visits. That is, about one third of the families referred 


~. 
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did not complete the {initial series of three to four screening and appraisal 
appontments and/or did not begin formal treatment when recommended. 
Therefore, the ‘present investination examin the factors sétentialiy: 
retated to the BCCGAC early attrition rate. The purposes of the present 
study were: (a), to develop a standarnized measure for the assessment of 
clients' satisfaction with stp on services, (b) to develon a systematic 
procedure for assessing clients' attitudes and impressions of clinic 
services prior to formal treatment (i.c., throughout the initial intake and 
‘dtagnostic evaluation eeauaneay, and (c) to -identify factors related to 
premature termination of families from child mental health services, 
. including client satisfaction with s i€es and denparanhte variables 
(i.e., client and therapist characteristics). It wi hynothesized that 
‘clients who terminated prematurely would be characterized by areater 
dissatisfaction with Clinic procedures and services. ; 
: Method | 
| Subjects ' 

The study dealt with 238 familics whose child (rancina in ane from 1 to 
18) was referred for outpatient mental health services over a 9-month 
period of time durina 1977-78. “While total child referrals durine this period 
was 270, 32 families were eliminated from the sample because of extenuatina 
ft cunetances (e.a., moved out of catchment area, family disruptjon due 
to death or serious illness, child removed from home, second “*., from 
the same family, client unable to read, etc.). The sample included 355 
arene who compriséd the primary population studied. Characteristics of 


the families studied are summarized in Tables 1 and 2. 


Instruments 
Three brief Client Satisfaction ee (CSAs) were developed 
(see Appendix A) and routinely administered throuchout: the assessment Vs 


sequence which typically involved three to four Clinic visits. Al} ‘Clinic 
staff were utilized in determining the content of the items. The endeavor 
was to cover as comprehensively as possible the various aspects of known 
(from client remarks) and suspected client dissatisfaction, while keepina 
the response format and length of the questionnaires as straightforward 
and brief as possible. 
The first questionnaire, labeled Form 1, was desianed to assess reactions 
to the Clinic prior to the initial interview. This 9-item questionnaire 
inquired as fs how the client learncd about the Clinic, the client's 
feelings about contacting the Clhic, whether the referral was voluntary or 
required, and how the feitiel-shone call and waitina period prior to the 
first appointments were perceived. Form 1 was administered when the parents 
arrived for the first screening appointment. Clients’ reactions to each 
interview in the screcning or appraisal sequence was assessed by a second 
CSQ, Form 2. This 12-item questionnaire inquired as to the clients' 
perceptions of the length of time since the previous contact, the reason for 


the visit, the clinician, the helpfulness of the Clinic in terms of 


understanding and correcting the problem, and the probability of 

returning for future visits. ~ Form 2 was issued immediately following 
“each evaluation interview. This questionnaire was also administcred to 
children 14 years of age or older after beina scen for evaluation. A 
third CSQ, Form 2S, is a shortened, 7-item version of Form 2, administered 


to parents following diagnostic interviews where only the child was seen, 


Table 1 
? 
Demographic Characteristics 
of Referred Children ~ 
in Sample (n=238) 


* 
a ee cae ee oe ne ee 


Characteristic — Frequency Percent 

Aysex 184 69 
0-6. | a 25 

B) Age 7-12. - 100 42 
iar © : 79 oye 

C) Race White 207 88 
Black a 1] 
Other 3 ] 


D) Presenting problems 1 


Discipline/behav. 114 48 
Communi cation 93 39 
Poor peer-sib : 
relations 89 37 
Temper’ 83 35 
Academic/learning 69 29 
Wi thdrawal- %, 
depressed — 55 23 
Hyperactive 49 21. 
£) Diagnosis A 
Adjustment/situational 
disturbance 116 50 
Behav. disorders 45 ~ “19 
Neuroses ~ 30 13 


| Parents typically listed more than one problem for the child. 
Presenting problems Itsted with less than 20% frequency not 
included in table. 


From Diagnostic and Statistical Manual, 2nd Ed. (DSM-IJ). 
Formal diagnosis was sometimes deferred through the evaluation 
study. Diagnostic categories not listed in table occurred 

at less than 10% frequency. ’ 
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Table 2 


Demographic Characteristics of 
. Parents in Sample (n=355) 


Characteristic Frequency Percent 
A) Age 
- Mothers Mean age 33.8 

20-30 96 ~ 42 
31-40 88 a2: 
41-50 33 14 
over 50 a 5. 
Fathers Mean age 37 
20-30 35 26 
31-40 56 42 
41-50 res 20 
over 50. 16 12 

B) Education ; / 
Mothers 
Below.h.s 59 25 
H.s 103 44 
Above h.s 70 31 ; 
Fathers 
Below h.s. 34 26 
H.s 51 38 
Above h.s 43 36 

C); Family Income 
Under 6000 78 34 
6-12000 55 25 
12-18000 A7 ‘20 
18-24000 27 12 
Over 24000 22 19 


Mean income , $11,900 r 
Mdn. income $ 9,600 


/ 0) No. parents 7 


’ in home 
1 109 45 . 
2 129 54 
~ 


| | 10 
| The ae typically involved choices between "true", "false", or 
"uncertain" responses with the ~— of three items on Form 1 that 


involved checking which of six to ei responses applied. Apnroximately ~ 
20%.0f all CSQ items were worded and scored negatively in order to help 
control for ragnonea bias. While there was an interest in constructing 
items that would provide unique information concernina satisfaction with 
different aspects of the Clinic's services, it was also important to have 
a single, overall measure of satisfaction. A scorina ayston was developed 
for each questionnaire and a total satisfaction score was derived for 
the clients followin all interviews. Total scores were computed by 
assigning the values 2, 1 and 0 to "true", "uncertain", and "false" responses, 
respectively, associated with all positively stated items (i.e., 1, 4, 6, 
7, 9, 10, 11, and 12). The values 0, 1, and 2 were assiqned to "true", 
"uncertain", and "false" responses, raspactively, for all neqatively 
stated items (i.e., 2, 5, and 8). Item 3 was scored 2 for the "just richt" 
and 0 for "too brief" or "too lona".. The sum of the item scores 
yields the total score. 

In order to evaluate the adeauacy of the items in the composite, 
correlations were computed between each item and the total test score. 
All correlations were positive and accentably hiah. Hence, the total 


score can be viewed as an acceptabte measure of aeneral satisfaction with 


Clinic services. 
; a 


Procedure 
CSQ Form T was issued by the receptionist prior to the initial interviow. 


The clinician, or interviewer, then issued Form 2 followina the initial 


session. All subsequent (Ss (Form 2 or 2S) were issued by the clinician 


I2 
ky 


ne 
following completion of each evaluation session. Clients were requested 
| to complete the css on the Clinic premises. All -clients (fami lies) 
seen for at cg one “antervicw were eliaible for inclusion in the study. 

“During a study period, an overall questionnaire return rate of 

approximately 80% was achieved. Table 3 summarizes the CSO return tates 
according to individuals as well as families represented in the study, 
Early in the study return rates were adversely affected by low issuance 
rates on the part of the staff. Consequently, a monetary incentive 
program was successfully instituted resulting in satisfactory coverane of 


Li) 


eligible respondents. a) 7 e = 

As can be seen in Table 3, the return rates are very similar for 
total individuals and font Ties’ suggestina that the CSAs were typically 
_issued to all eligible family members presént. The derattively low return 
rates for interviews later in the evaluation sequence is attributable 
to a reduction ff issuance rates by the staff. The issuance and return 
rates for children were so low that they could not be, eaacamiiye 
ici in the data analysis. ‘ 

Demographic and other indsnendent variables analyzed are -listed 
in Table 5. Included are: _ general characteristics of a clinician, 
referral source, prior treatment, presenting problems , diannosis, aiecea 
fanily characteristics, as well as more specific child and narent 
attributes, and certain time intervals (number of days) hetween various 
appointments during the evaluation sequence. In the latter catenory, the 
number of days intervening between telephone referral and initial 


appointment, between initial appointment and interpretive interview, and 


between psychiatric interview and the previous interview were studied. 
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Table 3° 


4 


; Client Sat#sfaction 
Questionnaire Return Rates 


Families Represented ' . ALL Individuals Seen 


Type of CSQ Number of Number Total Number p, 
Interview Form — Families ‘with cS0s PETC | paronts with Percent 
Seen 


CSQs 


Screening) 1 238 «(236 99 
Screening © 2 238 193 8] 
Clinical 2or2S 66 63 96 
Psychological 2 or 2S 24 21 88 
Psychiatric 2or25 94 | ne 
Interpretive 2 188 18 63 | 278 176 63 


14 
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The latter interval was selected because of frequent difficulties in 


~ scheduling psychiatric“interviews due to the limited availability of 


such services. 


The following criteria were utilized to classify the clients by 


termination status: 


(1) 


(2) 


The "follow through" cabonory tn=158) includes those ésaits oe So 
who completed the entire diagnostic sequence and accepted the” 
Clinic's ranctnendevions: When ongoing treatment was"facomishded, 
these clients kept - least one treatment session. 

Terminators were classified in one of the two followina catcqor- 
ies: 

(a) “Termination by mutual agreement" between client and 
clinician (n=23), These cases met at least onic of three criteria; 
namely, further evaluation was not indicated (i.e., problem 
insufficient to warrant further service), the problem was 
alleviated or resolved, and/or the referral was inanpropriate 
tone may have been referred elsewhere). 


(b) "Premature termination" (n=60) occurred where the client 


unilaterally decided to discontinue contacts with the Clinic. 


a 
These cases met at least one of four criteria: \nanel client 


decided the child notgin need of help, client failed or cancelled 
one or more interviews without reschedulina, client indicated a 
plan to.terminate duc to dissatisfaction with the Clinic's 
services, and/or the reason given by the client for termination 


did not seem justified by the clinician. 


The "termination by mutual agreement" subjects were combined with the 


"follow through" group and together they were viewed as having successfully 


7 | a 


14 
a¢comp] ished@th®” pretherapy objectives (i.c., evaluation of. the 
problem, mutually agreed upon a plan of intervention, and preliminary 
ouidanee 0€ follow through). Thus, completion of the evaluation sequence 
tonather with client-clinician agreement on conditions under which 
termination should occur were used.as the criteria against which the relative 
contributions of client satisfaction an demoaraphic variables were weighed. ° 


Seventy-six percent of the tahinated clients were equal W 


distributed over two interviews, that 15; “followina the j tial and ie 


interpretive sessions. The remainder were relatively pvenly distributed 


ot 


/ t 
/ 


across the intervening interviews. / J 
Results A 
/ , 

The major analysis effort focused on eee nebeteayint of variables 
that were related to premature termination.” The results are presented 
in terms of mean differenees and probabt Vity values deities classes of 
euplanaitery variables: (a) clinician or therapist, (b) cso responses 
or client satisfaction, and (c) demographic and other client characteristics. 

While data were avaiTaple on several clinician/therapist variables 
such as age and sex, there is little reason to describe the relationship 
between these variables and sienatine termination because the preliminary 
analysis of differences among 11 clinicians revealed nonsianificant. 
(p=.83).effects on the premature termination classification. That is, 
the proportion of clients who were classified as premature termination 
cases did not differ Significantly (or practically) across clinicians. 
Given the absence of difforences, data were combined for all clients 
across cl cians for remaining analyses. 

The/yelationship of CSQ tgtal scores with the premature termination 


classJ fication can be seen in Table 4. None of the comparisons of the ' 
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oo Table 4 


Comparison of Fol low Through and Premature 
Termination Groups on Total CSQ 


ee) Interview Mean 
CSQ Person Completing When CSO Follow ‘ Premature me rs 
| ‘Form . CSQ__' ~~ ~Ss Completed =~ «~Through = Termination _p / 
| 2 Mother ' Screening 19.83 20.0966 fC 


2 Father ° Screening 19.00 18.28 245 

\. 2 Mother Clinical 21:50 “24.43 93 
= 2 Mother Psychiatric 16.55 17.00 84 
a, We Father Psychiatric 19.00 19,33 .89 
ee Mother Interpretive 21.35 19.47 .07 


2°, Father Interpretive 20.65 § 18.89° * .28 
2S Mother » Clinical 12.03 11.83 .87 
2s Mother Psychological 11.71 12.00 +85 


a) values are probability values based on analysis of variance F tests 
on the mean differences between follow through and premature termination 
groups. 


” 


two groups yield p values below. 05. Separate anlyses, not presented 


in detail here, were carried out on cach item of the various CSO forms. 

It was found that no item* individually discriminated between the 

premature termpnation and follow through groups. In addition, discriminant — 
analysis procedures were employed to investigate the possibility that 

~ some linear combination of the item scores would discriminate between 

the two groups. Again, the results were disappointing, no combination 


of CSQ item scores discriminated between follow through and premature 


termination clients. — ; 
Demographic and other client characteristics constitute the third 

general ciags of variables employed to discriminate between follow ‘ 

through and premature termination groups, \ dumhary of the variables 

employed and the decceintad probability values can bo segh in Table 5. 

Two variables in this class have p values; equal to or less than .05. 


These variables are "hyperactivity" and Mother's education." 
: \ { . 


The summary statistics -for the hyperactivity variable are as 


follows : | $ 


\ * \ 


Premature 
Treatment Termination 
Hyperactive? NO 140 Y 42 
. YES 29 18 


If these frequencies are transformed intd proportions, we find that .17 


of the treatment croup and .30 of the premature termination ae re 


* Some items yielded individual p values below.05 but when the appropriate 
simultaneous inference procedures were employed, no siqnificant 
differences were identified. | 
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Table 5 


Demographic and Other Variables and 
Associated Probability Values* 


oO 


Referral Source lt 
me Intervals 
Phone to Screening Interval .60 
Screening to Interpretive Interval . 
Previous Interview to Psychiatric Interview 50 
Therapist Characteristics } 
Sex .68 
Age 57 
Family Characteristics : 
amily Size , woo 
Number of Pavents in Home .70 
Number of Children in Home | 49 
Gross Income 51 
Which Parents Seen .74 
‘Mother Characteristics ‘ 
Age  A4 
Race td 
Education 04 
On Medicaid 219 
Marital Status 19 
Parental Status 84 
Employed 64 
Father Characteristics 
ge .18 
Race me 
Education 16 
On Medicaid ; .93 
Marital Status 40 — 
Parent Status © : al? 
Employed ' ) 58 
Child Characteristics | 
Age .83 
Sex — 36 
Race ~ ’ .69 
Birth Order , , sez 
Prior Clinic Contact ; .69 
Prior Treatment Clsewhere .38 
Presenting Problems 
Underachievement — Jo7 
Disruptive Class Behavior att 
Discipline Problems 34 
Hyperactivity = .05 
Disruptive Behavior 94 


weep 


18 
Table 5 (continued) 


VARIABLE p 


. 


Stealing - 42 
Lying 91 
Sassing PK 
Temper Tantrums .28 
Withdrawn 90 
Communication Problems 72 
Bedwetting 29 
Sleeping 16 
Immaturity . .60 
Sibling Relationships 58 
Eating Habits .96 
Coordination Problems .66 
Diagnosis Classification .° — 218 


© 
‘ 


*These probability values are based on analysis of variance F tests 
or chi square tests depending upon whether the response variable 
was sealed continuously or as a nominal classification. 
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classified as hyperactive. In the case of the "Mother's education" 
/ 


variable, we find the following descriptive statistics: 


. Mean : Standard Deviation 
‘Treatment Group 12.03 f. oe 
Premature Termination 12.88 . 4.04 


Group . 

While the tests on the difference between Lpapaieinas in the case 
of "hyperactivity" and the difference between means (and standard 
sevtetians) in the case of "Mother's education" are statistically 
significant usina conventional univariate procedures, the use of such 
procedures must be questioned when a larae collection of variables 
is employed. When multivarite procedures that are desiqned to take 
into aceount the large number of variables included in this study are 
employed, mo significant effects are identified among those analyzed in 
this class of variables. 

In summary, none of the variables included in the three classas of 
explanatory variables reliably discriminated between treatment and - 
premature termination nes Not only did the individual variables 
fail to discriminate, but linear combinations of variables employed in 


complex discriminant function analyses were likewise unsuRcess hy 
, 


‘N 


Discussion 
Contrary to prior expectations, premature kati ato and clients 
who followed through with Clinic services were not distinauishable on 
wer the basts of the demographic and client satisfaction variables examined, 
“owt However, similar findings have been reported. With regard to the demn- 
oraptitc variables, a number of previous studies (40%) Pe dropout from 
child outpaticnt ‘programs have failed to find sinnificant differences 


between premature terminators and continuers in treatment (8ackeland & 
; 


20 
Lundwall, 1975). While neqative findings have been typical of the 
methodologically sound child therapy studies (e.q., “illiams & Pollack, 
1964), the more poorly desianed and inappropriately analyzed studies have: 
found significant effects related to client characteristics (Backeland 
& Lundwall, 1975). Further, the siqnificant rclationshins reported 
between demographic variables pertainina to socioeconomic status and 
premature termination have primarily been found in studies dealing with 
ailubt: populadtons: (Steen St-Alsg 1978) 1977. ‘The Tack of relationstd 
between client satisfaction levels and premature termination has alec 
been reported previously (Littlepane et i 1976). The present findings 
support the contention that clear relationships between client satisfaction 
and puteote in mental health proarams are not readily identifiable 
(Alberts, 1975). 

The definition of criteria for premature termination has been pointed ? 
out as a potential methodological problem in dropout studies (Backeland &- 
Lundwall, 1975; Brandt, 1965; Morrow et al., 1977). The extent to which : 
these criteria are arbitrarily defined may mask relationships between 
premature termination and other variables. The present definition of 
premature termination emphasized the lack of agreement between the 
‘clinician and client as to the services needed. An arbitrary scien 
defined cut-off for termination (i.c., failure to complete the screenisa 
and ‘diagnostic evaluation sequence) was utilized. The failure to find 
‘greater dissatisfaction levels among premature terminators suqaests that 
clients may have received the services they desired despite the lack of " 

ge agreement with the clinician as to the appropriate time for termination. 


It appears that the expectations of the client and therapist may differ 


considerably in terms of the services required and the anticipated outcomes. 


| 
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Thus, what the clinician defines as "premature" may net be to the clicnt. 
Difficulty in distinguishing between evaluation versus therapy (Brandt, 
1965) and short-versus long-term therapy (Littlepaqe et al., 1976) arc 
further examples of clients’ inability to differentiate between 

é arbitrary clinician definitions. Given these considerations, the validity 
oe of criteria for premature termination requires further specification and 

i arbitrary clinician-defined criteria (e.a., number of interviews held) 

appear inadequate. Incorporation of objective measures of outcome or 

"success" of services, in addition to clinicians’ judaments, is warranted, 

To the extent that the method of defining the premature termination 

group was valid, it can be concluded that the clients seemed satisfied 

3 with this Clinic's services and procedures. Relattvely high mean total 
scores on CSQs support overall high levels of client éatisfactian prior 
to the start of therapy. ; 

The failure of individual CSQ items to discriminate between premature 
termination and follow through groups suggests the possible operation of 
response biases by clients. Of particular interest were responses to 
items such as "I plan to return to the Clinic" (Form 2 item 11, Form 25 
item 6) where no differences were found batween qrouns, These data 
‘indicate that premature termination is not even predictable from what 
clients say they will do! Thus, the straightforward anproach of 
directly asking clients about their perceptions and attitudes toward Clinic 

| services yields little useful information in terms of nredictina dropouts. 
. Certain demand characteristics of the questionnaire administration proce- 
dure may also have influenced response sets. Since clients were asked to 


complete CSQs/{n the Clinic prior to leavina* implicit influences to 


_ * due to poor return rates with mailed questionnaires ina pilot study 


—y 


22 
respond psitively may have been operating. For example, CSOs were often 
issued by CMinicians that the client know wouldbe seeing the family again. 
Further, the present study was conducted early in clients' contacts 
with the Clinic which is often a time of considerable distress for clients. 
Questionnaire responses may have been exaaqerated in a positive direction 
by clients who felt the need to assure continued receipt of services. 
Continued deve lopment and validation of the CSOs are beina carrifd out 
ahi utilization of a greater number of scale values (e.9., 1-7 options 
versus True-False-Uncertain) is of particular interest. 

The present study potentially suffered from a lack of input from child 
clients. While parents have definite influences oh the decision to seek 
and continue services, (Baekeland & Lundwall, 1975), the influences of 
the child has not delineated. The extort of negotiation between the 
child and parent(s) in making the decision concernine returning to the 
clinic requires further assessment. While the present study attempted 
to receive ‘feedback from adolescents (14 years and older), low CSO return 
rates resulted inadequate data. More systematic assessment, of children's 
perceptions of mental health services would provide for interestina om 
comparisons (€.g., with parents', dropout rate, etc). Since cither the 
child or parent can have greater control in a given case, there is a source 
of confounding in the premature termination of families from child 
services that may not be nresent in adult services. The authors arc 
presently utilizing the CSQ method of assessino client satisfacticn with 
an adult population. 


Finally, a primary purpose of any proaram evaluation study is the 


provision of information of potential use in program plannina. The 


i 23 
present findings provide little in that regard. In terms of premature 
termination, it was not possible to identify specific client, therapist, 
or program characteristics that could be addressed in an effort to reduce 
the frequency of prema nure terminations. Taken with previous data, these 
results suggest that premature termination may iat be the "problem" that 
is typically assumed as clients who terminate prematurely are not 
necessarily more dissatisfied and may not be premature at 21]. The deqree 
to euen mental health programs have control over variables that could be 


wanlpulated to alter termination rates also appears quite limited. 


4 a 


Bernal, M.E. and Krutzer, S.L. Relationship between excuses and 


no” @ 
- Denner, B., & Hal priié, F, Measuring consumer ‘satisfaction in a community 
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APPENDIX A 


- 


Client Satisfaction Questionnaire Form 1 
" Client. Satisfaction Questionnaire Form 2 


Client Satisfaction Questionnaire Fortin 2S 


BATTLE CREEK CHILD GUIDANCE & ADULT CLINIC 


Questionnaire - Form l ’ 
FATHER 


Staff Member Seen: : Date 

1. I learned about the Clinic from: (Check one) ‘ 
___ Family doctor ___ Employer: 
___ School * Phone Book m 
___Friend ___ Service Agency (Name ) ‘ 
___Relative ~_Other (Where? ) 

True False Uncertain 
2. Coming to the Clinic was my own idea ........ ( ) ( ) ( ) 
3. I did not voluntarily come to the Clinic..... ( ) ( ) ( ) 


I feel my coming to the siaate is “dy 
required of me by 
what office or organization? 
4. I felt no hesitation in contacting the Clinic... .  ) ( ) ( ) 
‘- If I did hesitate,’ it was because....... 
(Check which items apply) 


___I don't really believe Clinic referral is needed, 
___I was concerned about what others might think or say, 
tt felt it was being required, rather than voluntary on my part. 
__My husband (or wife)’ was against it. 


K 


___I felt unsure about what the Clinic does. * 
ae thought it would cast too much. \ 
le d heard negative remarks about the Clinic from others. , 
“(Can you say what and by whom? - Please answer 


on the other side.) - 


5. Regarding the wait for my fret appointment, I 
(check one) ® 


thought it was reasonable. 
wish it were shorter. 


___wish it were longer. as 
; I didn't get one 
6. I found the brochure describing the Clinic's 2 
services HELP LU s ccs ses eesewawiewecalesoeees ( ) ( ) ( ) 
Answer the following 3 questions only if you made the ) 
first phone call to the Clinic: _ 
7. My first phone call to the Clinic was | 
Hel plu vies o:0.0.0is-0:ais Sewieee eacieeoeseee ( ) @ ) ( ) 
8. After my first phone call I felt (check which i | 
items apply) A k 
__confused ___hopeful ___neutral the J 
__relieved ___frustrated other? | 
9, I felt free to call the Clinic back 1f the | 
problem became more critical..........0. re ae coe ar oe 
29 | a 


\ / ae a 
BATTLE CREEK CHILD GUIDANCE & ADULT CLINIC 
MOTHER 
Questionnaire - Form 2 FATHER 
| s f ADULT 
Staff Member Seen: Date: 


Int¢rview: 


, True False Uncertain 
1.) I feel the length of time since my last contact 


' with the Clinic (visit or phone call) was 
reasonable ee © © © © © © © © © © © © ewe oe eo hl el ( ) ( ) ¢ ) 


2. I did not. understand the purpose of this visit... ( ) 


~~ 
—_ 
~~ 
~_ 


3. I felt today’ 8, visit was: 


, ae brief 


just right 


too long 


4, ,The person I talked with seemed to understand 
what I wags worried QUOUE {6 bho. hie WS es ee 


5. The visit(s) didn't help me get a better r 
understanding of the problem®. . 1. 6 6 6 0% e wwe C2 h. 23 ( ) 


6. I was given some suggestions or iinei that : 
i Sota ee TIGQhE TOW © 4 <6 <w ee. & eee we eS (>) ¢ ) ( ) 


a 2. feel more certain that the srghtna can be 
corrected 14s eee eee ee ee wee se eees C2) £-3 ( ) 


8. I don't know what the next deep in the hada ; 
WLLL DGS ie 4. bbe ei ee ewe SS Se es ee Oe ee Cs: ie “a ae | 


9. I agree with the recommendations made so far... . Cor 9 ( ) 


10. So far my contact with the Clinic has been 
helpful. eee @ © @ @ © © @ @ @ @ @ @ . oe ee @ @ x ) ( ) ( ) 


If not, briefly explain why. 


11. I plan to return to the Clinic... 1.1. 2s eevee (>) ¢) ie | 


12. I feel that I can call the Clinic at any time 
if the problem becomes more critical . . «+. + eos Coe QD ( ) 


nal 
— 


Additional Comments: 
% 


—3u 


( 


l BATTLE CREEK CHILD GUIDANCE & ADULT CLINIC 


\ Questionnaire - Form 2-S MOTHER 
i FATHER 
a ADULT 
Staff Member Seen: Date: 
Interview: 


‘ 
4 


> True False Uncertain 
1. I feel the length of time sinca my last contact ; \ 


with the Clinic (visit or phone call) was . | 
reasonable e e e e e e e e e e e e e ° e e . e . a e ( ) ( ) ( ) 


2. I did not understand the purpose of this visit. ..() ( ) ( ) 
3. I felt today's visit was: 
too brief 2 
just right 


‘too long 


4. So far my contact with the Clinic has been 
ReletGlh; 6.6.48 404 £6 ee eC Le eee ea eek DE Se OD 


If not, briefly explain why . 


4 5. I don't know what the next step in thé evaluation 
Pa WLLL Dea: i-6 bee & a ee a aera 6 EE) = oe SS 


6. I plan to return to the Clinic . .... 2.02522 +( ) ( ) ( ) 
2 rf ig 

7«,° I feel that I.can call the Clinic any time 

. ff the problem becomes more critical:.......-56( ) ()) (¢ ) 


Additional Comments: 


